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ABSTRACT 

This paper provides a cross-program view of the 
results of three successful school improvement programs that regional 
educational laJaoratories developed and implemented. The programs and 
their developers are; (1) A+chieving Excellence from the 
Mid-Continental Regional Educational LatKsratory; (2) onward to 
Excellence (OTE) from the Northwest Regional Educational Latjoratory; 
and (3) the School improvement Partnership Process (SIPP) from the 
Southwest Educational Development Laboratory. All three programs have 
Ijeen field tested and have demonstrated their efficacy for improving 
schools. Their intellectual roots lie in research on eff^^-^tive 
schools and school improvement processes. All three programs attend 
closely to involving school-based practitioners in decisions 
regarding improvements, maintain an information component so 
participants share knowledge, foster data-based decision making , 
provide personnel with a perspective that change takes time, and 
protect schools from unreasonable exi^ctations, in each case, outside 
assistance is a feature of the program. Limitations include: (l) 
disaggregation of data beyond student achievement; (2) a limited 
research baaej and (3) inadequate methods of assessment. These 
programs represent solid efforts to provide research-based guidance 
to teachers as they work to improve schools. There is a 21-item list 
of references. (SLD) 
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Introduction 

"IWs paper pwvUks a cross-program view erf the results of tiuee successful sc1k)o1 impnivmcnt 
programs that regkMialedwatitmallaborato^ TheiHOgramsaml 
their develq)es are: A-H*icvingExcclteiicefiDmtheNEd-<3t>ntincaiIte^ 
Uboratoiy (McREL); Qaward to ExceUence (OTE), Nonhw^ Regkmal FAif«t«iy^ni Laboratoiy 
(NWREL); aim the School Inqaovannit Iteaaship ftoccss (SIPP), Soutiiw^ Ediaaiional 
DevdopmciitLab(HBtoiy(SEDU AU three pro.srams have been fidd-testod and have 
doxKmstratedAeirefficacyfOThsqaovingschools. Their imcBeoual roots lie in two areas of 
research— the effective schools research and research on sclwol inqjrovement proems— thereby 
combining process and substance. 

Along wi& an analysis of the strengths the programs share, the p^ notes some (rf their 
limitations. It concludes with tentative recommemlations for improving these icsearch-bascd 
school improvement programs. 



Strengths 

AH three programs are built on researdi on effective schocds, effective instruction, and school 
improvement Consequently, the irognans attend closely to involving sdiool-bascd practitlonc] 
in decisions regarding improvements. I^cr, aU thitc pit^rams contain an infbnnaticm 
component so paxtiripants ^lare knowledge of and a language sboat iraearch findings related to 
scho(d and dassnxmi cficctiveness. In addition, the programs foster databased decisionmaking 
providing staff tssetabas with a framework for analyang the cunent status erf the schod. 
identifying gaps between what is and what they want the school to be. and reviewing cunent 
practice to aUgn curricula and implanent research findings concerning effectiveness. AU ihiee 
programs also provide district and school-site personnel with a pwspective tiiat change of any 

value takes time, and, in this way, protects the school from unieaUstk expectati 
improvement Finally, tiic programs offer outside assistaiwc. 
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Involving School Stqff 

The most commcm method for involving sdiod staff is through die develo|nnent ctf teadeiship 
teams that include teachers aiKi administratore. These teams may also include other schod-site 
professicmals. paients, central office administratcss, ai^ occasionally, students. 

Using icpiesemative teams saves tfaiee functions. First, it xeduces &c number of people the 
outside assistos have to wcric with, thus making the wok manageable. This is inqxHtant because 
tl« process of chan^ involves bnikiing sew uud»standinp. That is, the team con»s to v^ 
what is hai^ning in the schiwl and what could be through a cmnmcm set of lenses. They 
"consinictrBaUty"(Bcrgpr&Luclanan.l967)inawaytocanguid^ Hicoutside 
assistCTS need, then, to as^ss constriKtiais of reality at the start of the pnx«ss and provide the 
infofflMtionandtoolsinwa.jmeaningfidtoflicpartfcipants. Clearly, it is easier to do that with 
smaller, raAer than larr t, nunAras. Woddng with smaUer numbers also facilitates the assistcts' 
understanding of the local context, the culture, mores, and ways of interacting wifliin Oe school, 
district, and community. Tliis "local knowledge" (Gc^berg & Gallimoic, 1991) has inqxsrtant 
inq>licati(Mis fiw how the inqHovcment process laoceeds. The sohiticMis to local problems must 
ccHne throu^ the devekqjmcnt d shared meanings (Fullan, 1991), and the ••ams facilitate such 
development 

Leadership teams also provide a basis for "bottom-up" involven»nt Al&ough there are 
facile claims for the inqxHtancc of staff involvement (see, for cxan^le, Onwaid to Excdtence: 
"Research shows that involving &e school principal, other sclxiol staff members, and district 
office pCTsonnel joinfly in a school inqjrovemcnt effort increases success."), the issue is more 
complex (Fullan, 1991). Howcvor, ¥*aievcrflie paitfcular role is «rf staff involvwnent in planning 
and implementing tl» sctool imiHovtsnent program, die teadetship team at least saves as a touch 
point within the school fffl- the outside assisiers. In additicMi, it is likely the team nwmbers are 
better able to "sell" the improvement process to their colleagues Aan outsiders could. 

FmaUy, the leadership team devetops a fairly sophisticated understanding of research, social 

problem-solving procepses, and school in^rovcmcnt As a result, the outside agents leave behind 

both smjcture and c^jacityforcontinmnginqnovanort. Developing cdlegialrelationsh^ and 

databased decisionmaking can have an impaa on the school lOTg after the specific inq^ 
program is "conq)lcte.** 
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AUtfareeprogiamsccmtaina'laicmlcc^txaiisfe^ In all, the schod-site 

professionals, paiticolariy flic leader^iip team, arc introduced to concqjts drawn from research on 
efifectxveschcKds and effective iiistnu:tk»s. In addiitoii,dtter directly (as in t)» case of A-fchieving 
Excellence and SIPP) or as pan of ifae piopam itself, site pn^tioieTs become knowledgeable 
about leseaich cm school improvement 

The research base that is drawn upon covets cunktila,instnictkm, and te^ Fwcxan^le. 
widun OTE, staff members engage in aprocess of analyzing cunent instructional practice and 
conqwre it to effective instiuction. lbs A-Kihieving Excellence program also indudes information 
about effective instmctton, as well as the lelatioaship of the cunicuhnn to ^ testing pipgiam 
(cuuiculum alignment). 

Staff members at participating schools develc^ action plans to guide the inqdemmtation 
process. The external ^pnts provi(te a fiamewcak planning, based on what is known about 
school improvement processes and efifective staff devetopnmiL That is, Ae plans inchide 
descriptions of how progress will be monitored, new skills tanght and practiced, outcomes judged, 
arei procedures for adjusting the plans. Hie jdans also focus the attention of stafif to a limited 
number of issues or provide {biased attention to greatn-nmnbeis. Thefocusisinqxatantfo- 
success because trying too many things at once can be overwhehning. 

Tte programs* liniitations stem fiom the limitaiicms in the icscarch bases That 
is, the "effoctive-instrw^ion** research that is drawn uprai highlights genraic instructional 

approaches and docs not deal with content-spedfic issues. Tliis matter will be elabfflated in the 
discussion of program limitations. 

Databased Decisionmaking 

Perhaps the most important aspect irf the progran» is their attenticm to databased ded 

School personnd do nM tend to use hard data ID cvahMie tlttir activities and make decisions. 
Rather, they cq)eiB» on immediaie fecdbadc and n»e *intiiitive^ 

schools (Huberman, 1983; Uaiie. 1975; Cuban, 1988). Although the programs use different 
mechanisms, they carefully assess student cute)mes. including achicveim As 
the leadership tram and olhOT analyze the data, they can detemiine priorities fty inq^^ 
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The use of data is £un]itaied by the attcndcm the lacgiaim 
infonnatbn to the schocd staff. OIC, for exaiiq)le,2ffiq>aies a one-page display 1^ each ty^ 
data acconqanied by a narrative descr^nion. The profile data are mx^valuative so that staff 
nembcrs can exchange ondastanding of the nxaning of the data and jid^ how well tl»y believe 
they aieddng with legaid ID eadignmp of data. Scmswimt difiGomfy, A-Kdueving Excellaice 
provktes data about fee lelationrfiip rf the cmricnhiin to Ae testing pu ig ram tn ^f^^ tw^rfyrs in 
acyustingtocmeordieotfaer. litis type of infonnationhdps teachers andostaod student 
achievement patterns. 

Importantly, the programs &dlitate attaitifm to studoits finom different backgrounds. The 
SIP? program, for cxan^k, focu«^s much attention on disaggregating data to help teachers see 
how weUeducationaUy disadvantaged stucfems are pofoiniing. The data disaggregation diaws 
attention to particular stotents, and, in the case of SIPP, ctearly has payoffs in their achfevement 
That is, when ccfflqjared to simihff schods. tlw schotds in whidi jHindpals 
show statisdcally significant gieaiin dosing of the gap between the achievement of edocatimally 
disadvantaged and higher-incwnc students. The inqwrtanceofdisaggregaiion cannot be 
overenq>hasi2ed and should, I will aigne beUsw, be api^ied beycmd student achievement issues. 

KnaUy, data also are used to dcternni» how weU instnMSiooal pncticM 
on effective instruction. This allows staffmembos to identify strengths and wcakneracs and 
indicate areas fOT staff develqimentactivitfes. The lecture cf current prBCtu^ecoa^pared to *1)est^ 
practice beconaes the basis for the plan. The process in[5>teniraied has two advantages over other 
potential approaches. First, it wwks with schoolwide data, and thus avoids dealing with any 
particular teacher as "defident" It han^sses tte professii»ial ethos of all teachers ami helps build 
coIlegialinvMtmem in the in^vemeni process. Seoraid, it aiKhins instructional improvement in 
research, rather than in opinions (of which diere are many) of what constitutes good leaching. 
Ctonscnsus building activities can shift focus on goals rather than on procedure to le^ 
Those procedures are empirically derived. (As noted below, there is a downside to this approach.) 

Time Pttnpeetive 

The progranjs take as given that "change is a process, not an cvcnr (Han & Hold. 1987). All 
have multiyear time praspectives to introduce die process, mqylcsnent the ptoccdures, and evaluate 
outcomes. In some sense, this may be Ae most significant as^stancc to the schods. TheiHogram 
staff membCTS make it clear to sctnol and district personnel diat inqHovemsnt involves dedicating 
time aiKi effort and resuhs will not be immediate. 
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The to that d» itgk»ial labcmttcHies ait willing to adl^ 
inq)n>vementisaaecfittotbeiii,aiKlanaigiimaitfocaatin^ Public 
educaticm has long sm^fiv die mai^baltet and qoick fix. Indeed, given wheie we currently 
axe, one can sec the six **iiational educatkmal goals" as ignoring the findings of research on 

educaticmalia^veiiientinthecaUforti^achievaxra'liydieyearlOOa'* Ttie time pnspective 
Immght to these iBogiams ensphasizes apin diat in^TOvraient is a di 
peopled) relink cuaent|nact&» and learn new skins. And, to die extent that tteinqsovements 
face the basic problems ccWiXimtingeducatois, die task is moie difficult and time consuming. 

By providing die perspective diat change takes tinoe, the pn^ranis protect die schod 
participants fimn demands ftH-immedialepayt^. In sdiodswidinm^IBoblems,diis protection 
may also serve as a moale boosts for teaches. Hiat is, diey have the s^mce to attend to problems 
widiout being critKized for dieir failures. The outlook of die programs is moxe positive than 
riegative and recognizes dim liMlings of More lead as (tften to paralysis as to ^:tk}^ 

The time perspective, coiq>kd widi using leadersh^ teanos, also helps build a culture of 
collegiality and continuous inqaovement. wltich Bird aiKl littte (1985) found to be assodated widi 
improving scho(^s. It takes tinv to build such cultures, in part because diey rely on mutual trust 
among school-based ptofesskmals, and such trust is not automatic The time also is important 
because sclnxds as currently structured tend to isolate teachers £n»ii one anodier (Rosenholtz. 
1989). Collegial action requires attention to the logistics of getting teacters togedier, and, in fact, 
the time available is morn limited dian anyone wouM like. 

Outside Assistance 

Assistance from a nonschool organization such as a laboratory saves several functions in 
implementing school in^vement Rrst, lab stafif members have syndiesized and translated 
research into practical plications. SecoKl, dicy view die school widi fiesh eyes and provide 
interpretations of actions, processes, and culture that ac^ to a* OKxlify school persom^l 
perspectives. Innally, outsicfe assistance provides a continuing pressure to atteiKi to the 
improvement plan and protection fiom being distracted by the next fad diat comes alon g. 

The r^earch on schod and classroom efifectiveness is distilled in each of die programs. 
School-based prRctiticmers are clearly cq>abte of reading and understanding die research base, and 
many of them do. However, each diese programs has develqied techniques that ease 
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appUcatkm. Fofcxan^le, the sclKxdpiDfiles in 0TB £u:iHtatedaia display ami ui^^ 

Other techniques could be used, and school staff could develq) dieir own, but e£Bclency is served 

by the labs' activities. 

Fexfa^s even xnoreinqjortant, the external agents bring a dififeiem set ctfpnis^^ 
school £nmi those that aheady exist Hie school inqnovement process requires that teaches view 
tteirwoifcinnewways. That is, few teachers wish to teach badly carhxetevantcunicula. Because 
they judge thdr own efforts by how well classes go (Lortie, 1975), altonaie ways of assessing 
their effigts help them think about i mprovemen ts to undertake. It is not that die external agents 
know **bettcr**; raUier, they know "diffeent" They bring inieipietations of the meaning of policies 
and prurtices to the group. Thev under^andings will, in turn, be modified by the group's 
reactions and feedb«:k. Through this process, new undnstantfinp aie devdc^)ed, and plans for 
action can be devek^Kd. Thisoutsideas^stanoeispanicuhulyhelpful whenthediangeis a 
"multilevel, complex systoxMxieniBd innovation where what is being changed is the aganizational 
culture itselT (Fullan, 1991, p. 73). The duee school improvement programs are that type 
innovation. 

Finally, die external assistance bc^ prods and protects the inqmnrenttnt effort As Cnuidall 
et al. (1982) found, the comHnation of pressure and assistance led to improvement C^ice the 
district or school has '^signed on** to die lab pn^ram, scheduled dates for ovetings and staff 
devetopmcnt are taken seriously. The pressure may be subflc, because after all die major rote of 
the lab is to provide assistance, but it is dierc. No schocd staff wants to fail to live up to its skle of 
a bargain. 

Along with the pressure diat conaes finom the invt^vemem widi die laboratory program comes 
protection. Schoolanddistrictstaff buy time fnmidieircritks 1^ pelting to the improveme^ 
program. Indeed, inqm>vemeat program staff noenobers have to take care diat their involvement 
goes beyond the need to say to critics, Xook how hard Fm trying.** TTiey need to gain real, not 
just political, commitmem to die protection. In additi(m, if die superintendem comes back 

from a meeting witii a new i^an, school staff members can be saved £nnn immediate acticm on it by 
tiieir involvement widi die lab program. Obviously, dus does not always woik, but it does provide 
a bazrier against a constant barrage of new programs. 
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The three programs have much to rcccHnmend ihcm. They are built cm itsearc^ and {aovide 
extemted assistance wimnii%atingsc±ix)b ami distxk^ F^jrfter.ti^ draw attention to the 
acMeven^t of disadvaofaged stud»its. Bnalfy. diey {aovide a fiamewi^ &s -Jevelopiiig locally 
meaningful inqnovement plans. However, die programs also shave Ihnitaticns, which win 
discussed in the following section. 

Limitations 

I am a bit hesitant in discussing the lin&tations of the programs. Fixst,d»reisaodcNibtthe 
programs aie effective in their own toms. Oonseqiiendy,pdntingontlinut8!i(msmi^beaskhig 
the programs to change their goals. Second, I fear that changing d»pn%rams may cause diem to 
lose some of their value, aiul,iideed,in9o^ upon dion untested ideas. Ncmetteless, I will raise 
two limitations that could be addressed within die context of the current programs and one dial 
requires more It/ng-tran ccm^deration. 

Disaggngadon of Data Beyond StiuktU Achievement 

Cunendy, die programs assist staff hi disaggregating ^udent-reteddata. This cleaiiy has helped 
pardcqmting schools direct improvemen t ^orts towazd disadvantaged students. But focusing only 
on student outconKs linuts the infonmttkm that couU be useful in develqn^ 
improvement plan. It is imponant to find out the courses and instruction students receive as well 
as student outcomes. 

Widiin American schools, there are pattems of course taking and types cf instniction recdvM 
rehited to educational disadvantage. As Oakes (1990) states: 

Assessments of acstden^c aMli^, phicemoit in dififerent tracks or abiUty-grouped 
classes, and the reduced educational orapocnmiiies that characterize low-track 
classes ofienparalld race and social dab cSfifeiaioes.. .to die CTde^ 
in cUisses at m£SBrent alnli^ fevels afifects students' qrpoitunities to learn— and the 
evidence fiom our stuffy suggests dut die effects are ^te ?rof«ind-Hm^ 

students di^in^iQrtiaiably sufo whatever disadvantages acciue to stw^^ 
low-track class^. (pp.vi-vH) 

Fuidier, the efifects of race, social class, and locale exist on the elementary, as well as the 
secondary, level. A school engaged in an im proveme nt process, then, needs to look at patterns in 
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die courses stuctents are taking and tbecqypcaiuiiitfes 8^ Data disaggregation of this 

type will strengthen the diagnosis and presciipiicm for inyroveroent. 

Another type of data disaggregation oon(«im the ^ of instnictionstitd^itsrecx^ Again, 
research has revealed difi5a«n pattenis of iiistnwti(m (^fered to dis^ 

who are finom backgrounds of educatk»ial]»ivi]ege. (1990). forexan^le, found that leachei^ 
in schods serving laigely tower- and woridng-class students were likely to en^hasiie xote learning 
ai^ obedience to Buthraity in ccmtiast to teasdiefs of the privil^e4 win 
critical thinking. Data di^lays of surveys or obsovaticMis of instructional practice should be 
disaggregated so such discrepancies can be se«i. 

Finally, an analysis ai the Natkmal Educatismal Ixxngititdinal Study of 1988 (NELS: 88) 
revealed major diffoences in the quality of instruction educatifmally disadvantaged and prigged 
students receive (Hafner. 1991). For example, high sodoeconondc-status (SES) students are twice 
as likely as low-SES students to npm coiducting experiments in science das^ daily and weekly. 
Further 

There are indications that more advantaged, higher-achieving students are more 
likely ^ Ie»-advantaged youth to have teachers who m^jraed or nanoied in the 
subject they teach (e.g., math or sdmt) and diat poom, Omited-English pn^ient 
and lower-achieving sttidcnts are took Hirely than advantaged students to have math 
and science teachers who majored in education. (Hofoer, 1991, p. 16) 

The pregrams presented here demonstrate success in narrowing the gap between the 
achievement of educationally ]»iviteged and educatkmaHy disadvantaged students. Further 

attention to die educaticHial program that students actuaUy icodve wmiM pr^ 
base fOT changes in practice. Disaggregatimi of infbrmation about teacto and instnx:tional 
practice will serve tibat purpose. Such infonnation als> Irelps focus staff developmem and other 
improvement activities. 

Broadtning the Research Base 

The programs build on research fiom a set of kientifiable leseareh traditions— the effective schools 
research, reoarch m effcc^' ve instruction, research on schocd inqnoventtnt process^ and stafif 
dcvek^ment research. There is soone use. as well, erf die research on schooi-site leadership. 
These research bodies focus primarily on gniaic diaracteristics and arc neidier subjea-nattcr nor 
context-specific. Inchiding subject-matter- and context-specifk; research would, irxieed, change 



10 



9 



the nature of the school inqrovCTiemiq^ioscltes these Ifowever. toe is an 

aiigoment lobe made for ddog so. 

The procedures for diagnosing probl«ns and develof^g prescriptkms, u> use the language 
of OTE, enqdoyed in aU three im^grams focus on gieiiaic in^nictk^ 
Theyaslc Areteacteso^die^ofin^nict&mfouiidtofae^fectivebyieseaidi? Isthe 
cimiculnm aligned widi^tc^ ButinqxMantquestioosareleftoiitbyftesefocl 

In teiim of instnicdon, there are difiicraioes inefiecdve instnxnk^ 
acconaplish different ob^ves. Forexaii9le,thaeisa"consistait]^:tiirectftBadiingthat 
yieidls]achievem»it gains: teaching ttiat was highly structured and directed, involved «q;)I«^ 
eiq}lanaii(»i and modeling by the leadMr, and kept ^«]ents U^y ragaged with academic content** 
(Putnam etaL. 1991, p. 124). Ifowever.'^dii^emenf* is defined tere as scores <hi standardized 
tests, a limitation to be discussed later. In madinnatics, for eicanqjle, this picture of si^cessfol 
teaching woiks wdl when math is o(»iodved<tf as invcdving coaptation and routine problem 
solving. But if math is ccracdved to invdve a teoaderiangs of tasks *1nvtdving various kinds of 
nonrDudi^ problem solving, the mathematizatioii of sUoaticxis and judgments about the 
appropriateness erf m a thematic al models for varkms pmpoges, and tha me nf mathiayiariral 
argument and justifiaiiion''(PmnametaL. 1991, p. 126). tfien a different sort of instruction is 
wananted. A sinuhu- case can be made widiregatd to odier subjects. 

Shulman (1987) argues diat **^cdago0cal knowledge^* is iDOted in knowledge of the 
particular disdpliiw being taught The three schodhiqvDvement models pnesented here do mff 
provide a fianoewcnk for locddng at content areas, aid dioefore, do nm guide an anal^ 
instruction ^jpropriaiB to the goab and ot»jecti¥»ctf a psticularsul:^^ I^SIPPpjogramijjfl 
address specific content areas (for «canqde, writing), but it is not dear how die proc^ led to the 
focus. C)ne reason d»t this is important is diatcunn»it reform effoits in the subject areas include 
profound changes hi the ways knowing and learning are viewed, and school improven^t efforts 
should address those changes. 

The core of d» cuniculum issue for schoc^ ami teachera is (fetennining what knowl^ 
worth knowing and, therefae^teachhig. Arguably, die cssracc erf die **reflective practitioner^ 
(Scbon, 1987) is attmdon to **die role diat sctools actually pb^ widdn a race-, class-, and gmder- 
divided society** (McLaren, 1987. p. 40). Considaationcf such issues raises key issues of the 
knowledge validated by inclusion in the currkulum. The three school hnim>vem»it programs do 
not provide the space for such qi^stions. 
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One leascHi induding ccmtent-related ocmcems in a sdiorl impiDvement effort is to 
stiengAen zefonn efiTons. That is, what the thiee loi^rams embody about lanocess, oipacity 
building, ai^ stafif develq>meit could be well within tiie context of otfaa effcsts. For 
exan^le. in studying the in^leinentaiion d the Califoniia noatfa^natics ftamewcsk, OAen and his 
colleagues (1990) found uneven use. Tlie kind (rf assistance provided ftiDUghtl»kadeiship 
teams, fw example, could help Marie, who say^ "I can't teach whM I don't know** (Wilson, 
1990), if the leadership team were eDqx>weied with ccmtent, as well as process, knowledge. 

Including context-specific issu^ coukl address both the variations in school structures 
associated with their level and variations in treatment <rf students associated with socioeco^ 
stams. Given the data disaggregaticm, the inqm>venientniodels would be stretched, but not 
transfcamed, to attend to issues of differential treatment of students both wito schcxils and 
between schools. Hiese contextual concnns are nmcutimtly part of the pipgiams, but providing 
teachers with tocds to deal with them wouM be enqiowering. 

Assessment 

The final limitation of the programs that I win discuss has to do with assessment Currently, 
standardized adiicvonait tests are used as the base for evaluating student achievement Most of 
such tests measure student ^Mevement on a narrow band of skills and km)wledgc. The problem 
is, as Romberg (1992) says, "a growing consensus on ti» shift in goals for students... these goals 
cannot by achieved by current instructional practices in most schools, nor can school efforts to 
meet them be assessed using current tests" (p. 23). Within the school imi»ovement programs. 
reUanoe on standartfized tests to judge the currem status and pnc^ress in the schocri is a limi^ 
The limitation operates in two ways. Krst. school-based practitionas can only know how well 
students are doing in areas the tests measure. To the extent the tests feil to treasure inqxmant 
things, the leadership team cannot direct improvement efforts at them. Sccaid, the tests build on 
assumptions conccraing **flie sqjaraWHty of ends and mrans, and the moral neutrality of 
technique" (Berlak, 1992. p. 15). But there is no moral neutrality, and the tests reify and 
strcngtten the very Jmccs that influence stratification by dass, lacc, and gender. Both these 
issues are addressed below. 

Standardized tests tend to use "short-answer, closed-ended fonnatis] (tiiatj piedude the 
assessment of Wghcr-onler thinking and mastery of conq»lcx material" (Berlak, 1992, p. 8). Even 
when they invdvc problem solving, the focus is imi tl« answer rather than **the process of 
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achieving it or the nature of die task** (Rombeig, 1992, p. 24). Ccn^uently, when such tests axe 
us)?d as the 'Imseline** cm whidi fkoilty niranbera judge the quafity of the s(^^ 
in^TOvexnents, ±sit is much missing infonnaiion. Sdnol peisonnel can know, for exan^le, how 
well students add and subtract, but they axe unable to teUwiit^ther die students can address open- 
ei«3ed problem situations. Students may do well on the existing stnndardiTgd measures, but fail to 
meet the stai^ards embraced by the Natkmal Coundi (tf Teachers of Madiematics (1989). Tbt 
point is that using such tests does not provide inqxntant infomoadcm. 

Peiiiaps onro important, giv«i the eaq>hasis in diese inograms on improving schools for gU 
students, the tests xeinfbrce existing divisions by cla^, nice, anl gender. They rank-ader 
individuals on their "knowledge** of 1^ is ittchided in die test The tests ro»sure '^coostracts** 
that inevitably include value judgments and sul>)ective chdoes and, as a r^idt, are die ''prodiKts of 
power" (Beiiak, 1992, p. 185). Moves toward *'peifcsmance assesanent,** dien, are likely to be 
more fEor to stw!ents finom poor families, eduuc-minority stiuiai^ and giiis dian are current tests 
so Img as the pexfonnance deemed inqxvtant does also reflect issues of power and control. 
That is, there is a need for debate and discussion within the local context, of what knowledge is 
worth knowing and how we wiU know if someone else knows it The pr ogr a ms discussed hoe do 
not raise those questions. In the end, teactos not involved in discussions about such matters axe 
not fiilly en^wered, no matt^ what the xhetoric, becai^ they are not involved in decisions about 
the central issi^ of educatitm. 

Conclusion and Recommendations 

The three programs discussed here, A4chieving Excellence, OTE, and SWP, axe excellent 
programs. They represent sdid cflbrts to provide research-based guidance to teachers as they 
work to imjHove schools, paiticulafly how schools serve low-petfiorming students. School staffs 
have used the programs to improve educaticmal oppoitunides for students. Further, the processes 
used help build the capacity of school-based pn^esskmals to address new problems and concerns. 
Theattendcxitopnxxssandsiq)portisaninqx»tantattxibutetoaUthepn}gran^ It sq>axates these 
programs fasm those that hope for ini piovemen t through fiat or by providing shott-teim 
woiksh(q}s. Consequently, the success rate fm the programs is high. 

Despite the strengths, the programs slffireHmitatioDS. Betfa^ most iirportant, whatever tte 
rhetoric used tbofat local empowenoient, teachers rarely oigsge in thinking through the coie issi»s 
of education. Seccmd, the data disaggregadon, a stiengdi of die programs, is confined to 



13 



12 



disaggregating data alxmt studoit addevonent From diat infcBmadon, the local teams develop 
plans for inqnoveiwiit However, ^plam could be stxengdiened by disaggregation of teadier 
and program infomation as well Then, the teams could focus more clearly on relationships 
between school and classxoom processes and outcomes. Third, die programs draw upon research 
that addresses genmc issues and does iK)t relate to specific content areas or contexts. Thislimits 
their potential because key protons in sdKiols may not be recognized. AIso^ current state refonn 
effoits focus largely on curriculum ^su» and OHild benefit fitm the kind ctf assistance the sdiod 
in^>rovemait|ffograms provide. Finally, the xdianoe on standardized tests is limiting. 

The program developers must be careful in trying to make their programs better, even along 
the lines suggested l^e. Titty could graft onto carefully develops and tested programs some 
icteas that do ncH fit the assumptions that fiame the existing jnoc^ses and q)pro8che8. Hcwever, I 
think it is important £[V the developers to work on two issues: First, they sh(»ild develop some 
ways of invcdving school staff in basic cunkulum questions. Sta£r should not only look at 
whether the curriculum is aligned with die test, but whcAcr the curriculum focuses on important 
matters. The discussion of what constitutes an important matter requires guidance ani medKxis for 
addressing die fact that school staff may hold different (and sometimes competing) goals for 
educating students. The second point h related to the first: Staff med to attend to the issue of 
testing and whedier cuirent tests focus on what matters. Exploring alternative approaches to 
assessment will strengd^en discussions of what die cunkulum should be. This comMnation will 
empower teachers far beyond most current dte-based management programs. 
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